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IN THE CLAIMS: 

The text of all pending claims, (including withdrawn claims) is set forth below. Cancelled 
and not entered claims are indicated with claim number and status only. The claims as listed 
below show added text with underlining and deleted text with str i k e through . The status of each 
claim is indicated with one of (original), (currently amended), (cancelled), (withdrawn), (new), 
(previously presented), or (not entered). 

Please AMEND claims 3, 5, 7, 9, 1 0, 1 1 , 1 2, 1 3, 1 5, AND 1 6 and ADD new claims 1 7 
AND 18 in accordance with the following: 

1. (CANCELED) 

2. (CANCELED) 

3. (CURRENTLY AMENDED) A voice interactive system, comprising: 

a voice information input part inputting voice information of a first user from a first user 
terminal; 

a voice recognition part conducting voice recognition with respect to the voice information 
and analyzing contents of the voice information; 

a voice information mediation part controlling a transmission path of the voice 
information in accordance with the analyzed contents of the voice information; 

an interaction engine extracting contents of a response corresponding to the voice 
information by referring to a knowledge database and creating a synthesized voice in 
accordance with the extracted contents of the response; and 
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a voice information output part outputting the synthesized voice, wherein the voice 
information mediation part monitors at all times an average reaction time, from a response of the 
interaction engine to a reaction of the first user, and in each of a case where the average 
reaction time exceeds a first threshold value that is an upper limit of a reaction time in an 
ordinary interaction ef wand a case where the average reaction time is below a second 
threshold value that is a lower limit of the reaction time in the ordinary interaction, determines 
that an interaction between the first user and the interaction engine is not being smoothly 
conducted and allows a third-party user to participate in the interaction between the first user 
and the interaction engine, as a helper, from a terminal other than the first user terminal. 

4. (CANCELED) 

5. (CURRENTLY AMENDED) A voice interactive system, comprising: 

a voice information input part inputting voice information of a first user from a first user 
terminal; 

a voice recognition part conducting voice recognition with respect to the voice information 

and analyzing contents of the voice information; 

a voice information mediation part controlling a transmission path of the voice 

information in accordance with the analyzed contents of the voice information; 

an interaction engine extracting contents of a response corresponding to the voice 

information by referring to a knowledge database and creating a synthesized voice in 

accordance with the extracted contents of the response; and 

a voice information output part for outputting the synthesized voice, wh e r ei n t he voice 

information mediation part: 

monitors monitoring at all times whether or not an interaction between the first 
user and an interaction engine is being smoothly conducted and, in a case of 
determining that the interaction is not being smoothly conducted, aHews -allowing a third- 
party user to participate in the interaction between the first user and the interaction 
engine, as a helper, from a terminal other than the first user terminal and th e i nt e raction 
e ng i n e as a h e lp e r from a t e rm i na l oth e r than th e us e r t e rm i na l , ; 

determining a progress of interaction in accordance with an interaction time from 
a beginning of the interaction between the first user and the interaction engine and the 
number of accesses from the first user terminal to the interaction engine and th e numb e r 
of acc e ss e s from th e us e r t e rmina l to th e i nt e ract i on ong i no, ^ _and 
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changing a participation mode of the third-party user successively, in an 
increasing order of progress of interaction, from (1) involvement, to_(2) parallel input, and 
to (3) switching, and in a case where the participation mode is (1) involvement, permitting 
the third-party user to be involved in the interaction t o updat e cont e nts of i nt e ract i on 
between the first user and the interaction engine, updating contents of the interaction 
from the interaction engine to the first user before the content of the interaction is output 
to the first user, in a case where the participation mode is (2) parallel input, permitting the 
third-part user to conduct an input with respect to the interaction engine in parallel with 
the first user A and T in a case where the participation mode is (3) switching, permitting the 
third-part user to directly interact with the first use r in place of the interaction engine . 

6. (PREVIOUSLY PRESENTED) A voice interactive system according to claim 3, 
wherein the interaction engine further includes an interaction history information storage part for 
recording interaction history on a first user basis, and a helper selection part for selecting the 
third-party user that is considered to be most familiar with the contents of the interaction from the 
interaction history, as a helper, and the helper most appropriate for the contents of the voice 
information is selected. 

7. (CURRENTLY AMENDED) A voice interactive system, comprising: 

a voice information input part inputting voice information of a first user from a first user 
terminal; 

a voice recognition part conducting voice recognition with respect to the voice information 
and analyzing contents of the voice information; 

a voice information mediation part controlling a transmission path of the voice 
information in accordance with the analyzed contents of the voice information; 

an interaction engine extracting contents of a response corresponding to the voice 
information by referring to a knowledge database and creating a synthesized voice in 
accordance with the extracted contents of the response; and 

a voice information output part outputting the synthesized voice, wherein the voice 
information mediation part monitors at all times whether or not an interaction between the first 
user and the interaction engine is being smoothly conducted and, in a case of determining that 
the user's interaction is not being smoothly conducted, allows a third-party user to participate in 
the interaction between the user and the interaction engine, as a helper, from anoth e r ajerminal 
other than the first user terminal; 
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a help request notification part operative, in a case where the voice information 

mediation part determines that the interaction is not being smoothly conducted, to notify a third- 
party helper user of such fact^and: 

in a case where the help request notification part notifies the third-party user of the fact 

that the first user's interaction is not being smoothly conducted, the third-party user is capable of 

voluntarily interacting with the first user, and 

in a case where it is detected that only a voice of the third-party helper user continues, for 

a predetermined period of time or longer, in an interaction between the third-party user and the 

first user, the interaction engine interacts only with the third-party user. 

8. (CURRENTLY AMENDED) A voice interactive system according to claim 3, 
further comprising 

an interaction history display part displaying the interaction history stored in the 
interaction history information storage part to a third-party user; and 

a helper instruction part for receiving a help instruction from the third-party helper user, 
wherein: 

when the help instruction part receives the help instruction from the third-party 
helper user, the voice information mediation part enables the interaction between the 
third-party helper user and the user to be conducted, and 

when a degree of help of the third-party helper user exceeds a predetermined 
threshold value in interaction between the third-party helper user and the first user, the 
interaction engine interacts only with the third-party helper user. 

9. (CURRENTLY AMENDED) A voice interactive method, comprising: 
inputting a first user's voice information from a first user terminal; 
conducting voice recognition with respect to the voice information, and analyzing 

contents of the voice information; 

controlling a transmission path of the voice information in accordance with the analyzed 
contents of the voice information; and 

outputting a synthesized voice; and 

controlling a transmission path of the voice information, comprising: 

e xtract i v e extracting contents of a response corresponding to the voice information by 

referring to a knowledge database, and creating a synthesized voice in accordance with the 

contents of the response, and 
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monitoring at all times whether or not the user's interaction is being smoothly conducted T 
and A in a case where it is determined that the user's interaction is not being smoothly conducted, 
allowing a third-party user to participate , as a helper in the interaction between the first user and 
an interaction engine from another terminal as a h el p e r . 

10. (CURRENTLY AMENDED) A computer-readable medium storing a program to 
be read and executed by a computer for processing an input user's voice information, by: 7 

inputting a first user's voice information; 

conducting voice recognition with respect to the voice information, and analyzing 

contents of the voice information; 

controlling a transmission path of the voice information in accordance with the analyzed 

contents of the voice information; and 

outputting a synthesized voice, wherein: 

in the controlling of a transmission path of the voice information, contents of a 
response corresponding to the voice information being extracted by referring to a 
knowledge database, and a synthesized voice being created in accordance with the 
contents of the response, and 

in the controlling ofa -the transmission path of the voice information, monitoring 
at all times whether or not the user's interaction is being smoothly conducted 7 and A in a 
case where it is determined that the user's interaction is not being smoothly conducted, 
allowing a s e cond t hird-party user to participate , as a helper, in the interaction between 
the first user and an interaction engine from another terminal , as a h el p e r . 

11. (CURRENTLY AMENDED) A voice interactive system according to claim 5, 
wherein the interaction engine further includes an interaction history information storage part for 
recording interaction history on a first user basis, and a helper selection part for selecting the 
third-party user that is considered to be most familiar with the contents of the interaction from the 
interaction history, as a h e lp e r and th e h e lp e r and most appropriate for the contents of the voice 
information- 
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12. (CURRENTLY AMENDED) A voice interactive system according to claim 7, 
wherein the interaction engine further includes an interaction history information storage part for 
recording interaction history on a first user basis, and a helper selection part for selecting the 
third-party user that is considered to be most familiar with the contents of the interaction from the 
interaction history, as a h el p e r, and th e h e lpe r and most appropriate for the contents of the voice 
information i s s ele ct e d . 

1 3. (CURRENTLY AMENDED) A voice interactive system according to claim 5, 
further comprising; 

an interaction history display part displaying the interaction history stored in the 
interaction history information storage part to a third-party user; and 

a helper instruction part for receiving a help instruction from the third-party helper user, 
wherein: 

when the help instruction part receives the help instruction from the third-party 
helper user, the voice information mediation part enables the interaction between the 
third-party helper user and the user to be conducted, and 

when a degree of help of the third-party helper user exceeds a predetermined 
ihreshoid vaiue in interaction between the third-party helper user and the first user, the 
interaction engine interacts only with the third-party helper user. 

14. (ORIGINAL) A voice interactive system according to claim 7, further comprising 
an interaction history display part displaying the interaction history stored in the interaction 
history information storage part to a third-party user; and 

a helper instruction part for receiving a help instruction from the third-party helper user, 
wherein: 

when the help instruction part receives the help instruction from the third-party 
helper user, the voice information mediation part enables the interaction between the 
third-party helper user and the user to be conducted, and 

when a degree of help of the third-party helper user exceeds a predetermined 
threshold value in interaction between the third-party helper user and the first user, the 
interaction engine interacts only with the third-party helper user. 

15. (CURRENTLY AMENDED) A voice interactive method, comprising: 
inputting voice information of a first user from a first user terminal; 
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conducting voice recognition with respect to the voice information and analyzing contents 

of the voice information; 

controlling a transmission path of the voice information in accordance with the analyzed 

contents of the voice information; 

extracting contents of a response corresponding to the voice information by referring to a 

knowledge database and creating a synthesized voice in accordance with the extracted contents 

of the response; and 

outputting the synthesized voice, wh e r ei n t he voice information mediation part: 

mon i tors monitoring at all times whether or not an interaction between the first 
user and an interaction engine is being smoothly conducted and, in a case of 
determining that the interaction is not being smoothly conducted, atiews -a I lowing a third- 
party user to participate in the interaction between the first user and the interaction 
engine, as a helper, from a terminal other than the first user terminal and th e interact i on 
e ng i n e as a h el p e r from a t e rm i na l oth e r than th e us e r t e rm i na l , ; 

determining a progress of interaction in accordance with an interaction time from 
a beginning of the interaction between the first user and the interaction engine and the 
number of accesses from the first user terminal to the interaction engine and th e numb e r 
of acc e ss e s from th e us e r t e rm i na l to th e i nt e raction e ng i n e , ;_and 

changing a participation mode of the third-party user successively, in an 
increasing order of progress of interaction, from (1) involvement, to (2) parallel input, and 
to (3) switching, and in a case where the participation mode is (1) involvement, permitting 
the third-party user to be involved in the interaction t o updat e cont e nts of int e ract i on 
between the first user and the interaction engine, updating contents of the interaction 
from the interaction engine to the first user before the content of the interaction is output 
to the first user in a case where the participation mode is (2) parallel input, permitting the 
third-part user to conduct an input with respect to the interaction engine in parallel with 
the first user A and T in a case where the participation mode is (3) switching, permitting the 
third-part user to directly interact with the first use r in place of the interaction engine . 

16. (CURRENTLY AMENDED) A computer-readable medium storing a program to 
be read and executed by a computer for processing an input user's voice information, by: 

inputting voice information of a first user from a first user terminal; 

conducting voice recognition with respect to the voice information and analyzing contents 
of the voice information; 
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controlling a transmission path of the voice information in accordance with the analyzed 

contents of the voice information; 

extracting contents of a response corresponding to the voice information by referring to a 

knowledge database and creating a synthesized voice in accordance with the extracted contents 

of the response; and 

outputting the synthesized voice, wh e r ei n t he voice information mediation part: 

mon i tors monitoring at all times whether or not an interaction between the first 
user and an interaction engine is being smoothly conducted and, in a case of 
determining that the interaction is not being smoothly conducted, aHews -allowing a third- 
party user to participate in the interaction between the first user and the interaction 
engine, as a helper, from a terminal other than the first user terminal and th e i nt e raction 
e ng i n e as a h el p e r from a t e rm i nal oth e r than th e us e r t e rm i na l , 1 

determining a progress of interaction in accordance with an interaction time from 
a beginning of the interaction between the first user and the interaction engine and the 
number of accesses from the first user terminal to the interaction engine and th e numb e r 
of acc e ss e s from th e us e r t e rmina l to th e i nt e ract i on e ng i n e , ; _and 

changing a participation mode of the third-party user successively, in an 
increasing order of progress of interaction, from (1) involvement, to_(2) parallel input, and 
to (3) switching, and in a case where the participation mode is (1) involvement, permitting 
the third-party user to be involved in the interaction t o updat e cont e nts of i nt e raction 
between the first user and the interaction engine, updating contents of the interaction 
from the interaction engine to the first user before the content of the interaction is output 
to the first user, in a case where the participation mode is (2) parallel input, permitting the 
third-part user to conduct an input with respect to the interaction engine in parallel with 
the first user A and 7 in a case where the participation mode is (3) switching, permitting the 
third-part user to directly interact with the first use r in place of the interaction engine . 

17. (NEW) A voice interactive method, comprising: 

inputting voice information of a first user from a first user terminal; 

conducting voice recognition with respect to the voice information and analyzing contents 
of the voice information; 

controlling a transmission path of the voice information in accordance with the analyzed 
contents of the voice information; 
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extracting contents of a response corresponding to the voice information by referring to a 

knowledge database and creating a synthesized voice in accordance with the extracted contents 

of the response; and 

outputting the synthesized voice, while monitoring at all times whether or not an 

interaction between the first user and the interaction engine is being smoothly conducted and, in 

a case of determining that the user's interaction is not being smoothly conducted, allowing a 

third-party user to participate in the interaction between the user and the interaction engine, as a 

helper, from a terminal other than the first user terminal, and: 

in a case where the interaction is not being smoothly conducted, notifying a third- 
party helper user of such fact, 

in a case where the third-party user is notified of the fact that the first user's 
interaction is not being smoothly conducted, the third-party user is capable of voluntarily 
interacting with the first user, and 

in a case where it is detected that only a voice of the third-party helper user 
continues, for a predetermined period of time or longer, in an interaction between the 
third-party user and the first user, controlling the interaction engine to interact only with 
the third-party user. 

18. (NEW) A computer-readable medium storing a program to be read and executed 
by a computer for processing an input user's voice information, by: 

inputting voice information of a first user from a first user terminal; 

conducting voice recognition with respect to the voice information and analyzing contents 
of the voice information; 

controlling a transmission path of the voice information in accordance with the analyzed 
contents of the voice information; 

extracting contents of a response corresponding to the voice information by referring to a 
knowledge database and creating a synthesized voice in accordance with the extracted contents 
of the response; and 

outputting the synthesized voice, while monitoring at all times whether or not an 
interaction between the first user and the interaction engine is being smoothly conducted and, in 
a case of determining that the user's interaction is not being smoothly conducted, allowing a 
third-party user to participate in the interaction between the user and the interaction engine, as a 
helper, from a terminal other than the first user terminal, and: 



10 



Docket No.: 1359.1052 Serial No.: 09/940,522 

in a case where the interaction is not being smoothly conducted, notifying a third- 
party helper user of such fact, 

in a case where the third-party user is notified of the fact that the first user's 
interaction is not being smoothly conducted, the third-party user is capable of voluntarily 
interacting with the first user, and 

in a case where it is detected that only a voice of the third-party helper user 
continues, for a predetermined period of time or longer, in an interaction between the 
third-party user and the first user, controlling the interaction engine to interact only with 
the third-party user. 
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